Improved motion compensation for 360° video projected to polytopes

نویسندگان

  • Johannes Sauer
  • Jens Schneider
  • Mathias Wien
چکیده

360◦ video consists of images capturing the complete scene as seen from a single point in any direction. In contrast to conventional images, 360◦ images cannot be natively represented in a planar fashion. Consequently, video created from a sequence of 360◦ images suffers from geometric distortions. These are caused by mapping of the images from a sphere in 3D space to a planar image. This paper introduces an approach to improve motion compensation for 360◦ video by compensating the geometric distortions resulting from projection to the faces of a polytope. Each face is extended with content projected from faces connected to it. This provides better prediction candidates for motion compensation at face borders. Here, the applicability of the proposed method is demonstrated for 360◦ video projected to the faces of a cube. An evaluation of the method on two sets of sequences, static camera and non-static camera, verifies its effectiveness. It works especially well on non-static camera sequences, which have plenty of global motion. For the non-static camera sequences in the used test set rate savings of −2.14% were achieved.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An Improved Motion Vector Estimation Approach for Video Error Concealment Based on the Video Scene Analysis

In order to enhance the accuracy of the motion vector (MV) estimation and also reduce the error propagation issue during the estimation, in this paper, a new adaptive error concealment (EC) approach is proposed based on the information extracted from the video scene. In this regard, the motion information of the video scene around the degraded MB is first analyzed to estimate the motion type of...

متن کامل

New adaptive interpolation schemes for efficient meshbased motion estimation

Motion estimation and compensation is an essential part of existing video coding systems. The mesh-based motion estimation (MME) produces smoother motion field, better subjective quality (free from blocking artifacts), and higher peak signal-to-noise ratio (PSNR) in many cases, especially at low bitrate video communications, compared to the conventional block matching algorithm (BMA). Howev...

متن کامل

Steinbach, Wiegand, Girod: Using Multiple Global Motion Models for Improved Block-Based Video Coding, in Proc. ICIP'99 USING MULTIPLE GLOBAL MOTION MODELS FOR IMPROVED BLOCK-BASED VIDEO CODING

A novel motion representation and estimation scheme is presented that leads to improved coding e ciency of blockbased video coders like, e.g., H.263. The proposed scheme is based on motion-compensated prediction from more than one reference frame. The reference pictures are warped or globally motion-compensated versions of the previous frame. A ne motion models are used as warping parameters ap...

متن کامل

Steinbach, Wiegand, Girod: Using Multiple Global Motion Models for Improved Block-Based Video Coding, submitted to ICIP'99 USING MULTIPLE GLOBAL MOTION MODELS FOR IMPROVED BLOCK-BASED VIDEO CODING

We present a new motion representation and estimation scheme that leads to improved coding eeciency of block-based video coders like e.g. H.263. The proposed scheme is based on motion-compensated prediction from more than one reference frame. The reference pictures are warped versions of the previously decoded frame. AAne motion parameters are used as warping parameters approximating the motion...

متن کامل

A Segmentation-based Triangular Mesh Generation Scheme for Mesh-based Video Coding

A new mesh generation algorithm is proposed for mesh-based video coding. The still segmentation result of watershed segmentation is projected onto motion segmentation result of change region detection in proposed algorithm. Therefore, mesh presentation generated by our new method is able to reflect both spatial and temporal features of input video sequence. This experimental results show that m...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017